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This ds an evaluation report of a New York City 
school district educational project funded under Title I of the 
Elementary and Secondary Education Act of 1965* The program was 
designed to provide bilingual instruction to pregnant school-age 
girls who were two or more years below grade level in reading and 
mathematics. It was also designed for students who were deficient in 
their ability to speak and understand English. Approximately 40 
Spanish'-speaklng students^ aged 13 to 19^ were enrolled in the 
program; however^ due to poor attendance and a high rate of 
attrition, there were only 20 students on register at any particular 
time. A bilingual teacher/ and an educational assistant conducted the 
program of individualized instruction under the supervision of the 
school principal. Achievement data are presented for reading and 
mathematics* A historical regression analysis was used to compare 
actual posttest scores with anticipated posttest scores. Although 
this method of data analysis did not reveal statistically significant 
gains in reading and mathematics/ it did show that students gained 
over one month in both reading and mathematics for each month of the 
treatment period. Students made statistically significant gains in 
Spanish vocabulary and comprehension. The program objectives were met 
for those students who participated in the program* (Author/BS) 
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CHAPTER I 
THE PROGRAM 



A program of bilingual instruction in reading and mathematics 
of pregnant non*English Speaking students was conducted iDe- 
tween Pebriiary 3 1 1975 a^d the end of the current school year 
at the Center of Continued Education (PS 911 M) ^ 22 East 
128th Street 3 New York City , This program was desipied to 
provide bilin^al instruction in reading and mathematics to 
pregnant school-^age girls to whom English was a second lan- 
guage and who were two or more years retarded in the two 
subject areas* The students ranged in age from 13 to 19 years, 
and resided in economically deprived areas, principally in 
East Harlem* Spanish was the principal language spoken in the 
students ^ homes , 

Diiring the course of a school year, approximately 40 students 
were enrolled in this special program, with a maximiHQ of 20 
on register at any particular time* The pupil population vms 
highly transient. Students had frequent clinic appointments, 
were absent because of illness associated with their pregnan- 
cies, left school to have their babies, and retwned after 
two or three weeks to resume their studies * Attendance, be- 
cause of these factors, was approximately 

The major thrust of this program consisted of bilingual ln« 
struction in reading j language arts, and mathematics^ Under 
the supervision of the school principal, a bilingual teacher 
fluent in both Spanish and English, and a bilingual education- 
al assistant worked with the students individually or in small 
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groups, in order to Improve their reading and mathematics 
levels. 

Dm*ing a six-period day, students attended a varied program 
of activities which included hi lineal and English instruc- 
tion in regular hi^ school subjects as wall as sequencas in 
Spanish Culture and English as a Second Language* Each child 
was programmed individually, since there was wide variations 
within the group In comprehension of English^ aven though the 
speaking English of most of the students was inadequate* In 
every subject area^ howevor, the emphasis was on the building 
of vocabulary and comprehension skills , and speaking and 
reading knowledge of the two languages. The total program of 
each student was based upon an analysis of his individual 
needs, and was changed as the student matiired academically* 

Students were placed in this special program if their ability 
to speak and comprehend English and their reading find mathe- 
matics levels were two or more years below grade. The selection 
procedure also included the administration of the Language 
Ability Scale and interviews with the school giiidance counselor 
and the Title I bilingual teacher* 

The bilingual teacher coordinated each student's program as 
she attended repalar high school courses in the building, 
conferring with teachers where problems arose, and discussing 
each student *s progress with teachers and the ^idance comi^ 
selor of the school* Thus he was able to give support to the 
student during the periods in which she was not under his 
direct superv^ision. 
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CHAPTER II 
EVAHJATI^ PROCEDU^S 



The ©Yaluation objectives for this program were as follows: 

1. As a result of participation in the prograin 
of bilingual instruction in reading, students 
will show a statistically significant difference 
between real post-test seorea and anticipated 
post-test scores p based upon the results from 
the ar'mlnistratlon of the Metropolitan Reading 
Achievement Test. CHistorical Regression Design) 

2p As a result of participation in the program 
of bilingual instruction in mathematical 
students will show a statistically significant 
difference between real post*test scores and 
the anticipated post-test scores^ based upon 
the results from the administration of the 
Metropolitan Arithmetic Aohievement Test. 
(Historical Regression Design) 

3 I. As a result of participation in the program 
of bilingual instruction, students will show a 
statistically significant difference between 
pre-test and post^test scores, based upon the 
results of the adjainistration of the Cooperative 
Inter-American Test, given in Spanish, 
(correlated t design) 



The Metropolitan Achievement Tests were administered by an 
English teacher at PS 911M. The CooperatlTe Inter-American 
Test administration was carried out by the Title I bilingual 
teacher* The Interaediate I^vel forms of the Metropolitan 
Achievement Test were used for both reading and arithmetic* 
Since no grade norms were available for the Cooperative Inter- 
American Test (Spanish), the average of the raw scores ob- 
tained on the vocabulary, reading comprehension, and language 
sections of the test were used in data analysis. 



All pre-test procedures were conducted during December, 1974 
and January, 1975* The post^tests were adMnistered during 
the last week in May and the first week in June, 




The eTaliiatlon objectives were mat, excepting for data loss* 
Several conditions were present which made it impoaaible for 
all participants "who were on register during the treatment 
period to he included in the data analysis* Ten girls with* 
drew from school durtng the treatment period (3 to 4 months) 
to give birth of their babies • One girl transferred to 
another school dicing this period, The population of the 
school was very transient, with students required to attend 
clinics, or needing to stay home imtil arrangements were 
completed for the care of their infants* Irregular attendance 
made it difficult for tests to be administered during both 
the pre- and post-test period* 

A fm^ther limitation on the eTaluation proeed\ira was imposed 
by late funding of the project* The official starting date 
was Pebruary 3 , aiid the pre^-testing took place in February 
and March. This restricted the treatment period to 3 or 4 
months, depending on when each student reeaiired her first 
test. The e valuator-* consultant asked for post^test data to 
be available on June 9, in order that he would have sufficient 
time for data analysis and report writing* This imposed some 
hardship on the teachers who were responsible for atoini staring 
the teiinlnal tests. 

The evaluation objectives were carried out as projected , 
excepting that considerable data loss occwred, primarily 
because students withdrew from school in order to give birth 
to their babies. Some of these students rettirned to school 
after their babies were born; others remained at home* The 
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figures on data loss are fumished on the Data Loss Form, 

attached to the MR Items #30. 
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oHAPm III 

nNDINGS 

The first evaluation objective predicted that participants 
in the bilingual program would show improvement in reading, 
following the treatment period, such improvement being 
demonstrated by a statistically significant diffdrence be- 
tween the real post-test scores and the anticipated post- 
test scores (Historical Regression Design). A Btatlstically 
significant difference was not obtained, (See Table 1) 

The second evaluation objective stated that participants in 
the bilingual instruction program in mathematics would show 
improvement in this subject-matter area, such improvement 
being demonstrated by a statistically significant difference 
between the real post-test scores and the anticipated post- 
test scores (Historical Regression Design), Again, a statis- 
tically significant difference was not obtained, (See Table 2 ) 

The third evaluation objective stated that participants in 
the programs of bilingual instruction would show a statistically 
significant difference in Spanish vocabulary and comprehension 
between the pre-test and post-test scores on the Cooperative 
Inter- American Test (correlated "t" design), A statistically 
significant difference was obtained (p^.Ol) . (See Table 3) 

It should be noted that although statistically significant 
differences were not obtained between the real post-test scores 
and the anticipated post-test scores in reading and arithmetic, 
meaningful gains of approximately one-half year were obtained 
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Table 1 

Results! Metropolitan Achieviient Test - RBading 



Pridicted Obtained 
Corponent Activity Total Group Nuiber Pratest Posttist Posttest Value Significance 
Code Code Participants ID Jested Mean Mean Mean of t Unl 



66?1§,16 720 21 13,16 11 6.6 7.W 1.29 ■ not 

sipificint 

■ 

Table 2 

It 

Results; Metropolitan Achievement Test - Arithmetic 



Predicted Real Obtained m 
Coinponent Activity Total GrQUp Number Pretist Posttest Posttest Value Sipificance 
Code Code Participants ID Tested Mean Mean Mean of t "Lflvel 



6681^,16 720 21 13,16 10 6.3 6.32 7.04 1.31 not 

sipificant 

Table 3 

Results: Cooperative Inter-Aierican Test 

Obtained 

Coiponent Activity Total Group Number Pritest Posttest Posttest Valui Slgnificanci 
Code Code Participants ID TeBted Mean Mean Mean oft ml 



66713,16 720 21 ' 13,16 13 22.69 2i.30 t ^,97 pi.Ol 
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when on© eomparas the. real and anticipated poat^test scores, 
in both aubjaet-mitter areas • ^us the students gained 
more than one month in reading and arithmetic for each month 
of treatment. Th^ amll ntmber of students vAose scores 
were analyzed affected the power of the statistical test 
usedy thus creating a situation where meaningful differences 
could be declared statistically sipiif leant. 

The bilingual teacher and his educational assistant were 
furnished vrtth an abundance of materials for use in the pro- 
gram j supplementad by teacher-made Instructional devices* 
The special-class room was well located and beautifully main- 
tained and it ymm easily adaptable for the frequent use of 
audio-visual aids. 

The program was carried out with faithful adherence to the 
plans Trtiich were set forth in the project proposal* It serve< 
the population of bilingual prepiant girls who were fotmd to 
be two or more years retarded in reading and arithmetic, the 
specific population for which the program ras designed. 

Although this program does not represent a recycling of a 
prior project under Title 1, a similar program, fimded under 
Urban Educatloni ymm carried out In the school during the 
1973-74 school year. Seven of the nine reconmendatlons made 
by the evaluator-consultant of this prior program have been 
carried out during the 1974-75 program: a. the bilingual 
teacher should teach Spanish to girls other than those ^A^o 
are bilingual • b. the teacher's role should be expanded to 
allow for the development of materials; c. the cwrlculum 
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should be au©nent©d by the deyelopment of courses in 
business and professional Spanish^ d» the educational aide 
should make home visits, accompanying the school aoclal 
worker in this actlTity; e, an tmderstanding msculine fi- 
gwe should be retained as the one who, wider the principal 
of the school I coordinates the program; f , pre- and post- 
tests in Spanish should be Incorporated into the program | 
and g* greater effort should be made to encourage better 
attendance of the students* All of these reconmendatlons 
were accepted and acted upon positively. 

Two other reconmendations were not carried out, although 
every attempt was made by the school principal to follow 
through on these recommendations* It was suggested that a 
Spanish-speaking physician (female) be assigned to the 
school for one half or one full day a week. A request for 
such an asslgmnent was not acted upon* Again, a further recom- 
mendation TOS made that a nursery be established in the school 
so that students could return to school after their babies 
were born; it was not possible to fund such an arrangement. 
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CHAPTER 17 

SUmARI OF MAJOR PINDINQS , CONCLUSIONS, AND MCOMffiNDATIONS 

A program of bilingual instruction (English-Spamlsh) in read- 
ing and mathematics of pregnant non-English speaking students 
was conducted at the Center of Continued Education (PS 911M) 
between Fabiwry 3rd and the and of the school year. The 
program emphases were on bilingual instruetion in reading , 
language arts^ and aritlunetic. A bilingual teacher ^fluent 
in English and Spanish, and an educational assistant conduct- 
ed the program under the supervision of the principal of the 
school. 

The evaluation objectives were concerned with measuring the 
improvement In reading as measured by the Metropolitan Reading 
Test, and gains in arithmetic skills, as measured by the 
Metropolitan Arithmetic Test* A historical regression design 
was used to oomp^e real post-test scores with anticipated 
post-test scores. No statistically significant differences 
were fotuid between the scores used in the comparisons. However, 

in both reading and arithmetic ^ s t uden ts ga1 ned over one month 
for each month of the treatment period. 

An additional evaluation objective was stated in terms that 
students participating in this bilingual instruction program 
would show statistically significant gains In Spanish vocabu* 
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lary and comprehenaion whan a comparison was made between 
pre^-tast and post-»test saores on the Cooperative Inter- 
American Test* The results showed a statistically significMit 
difference at the ^01 level (Correlated t Desi^)# 



There were no discrepancies between the program as set forth 
in the project proposal and the actual operation of the 
program. It served the appropriate target population, and 
was carried out effectively by the teaching staff , 



Reconnnendatlons for further implementation of the program 

are as follows: 

1# The program should be recycled diiring the next 
academic year. It serves a specific need 
which ordinarily cannot be met by a regular 
high school program J and the findings of this 
evaluation study indicate that meaningful 
academic gains have resulted from the partici- 
pation of students in the pro-am* 

2. An attendance teacher , with social*-work back-* 
ground should be assigned on a ^rt--time basis 
to this pro-am. The services of such a 
professional worker should be able to facili- 
tate the Improvement in the attendance of the 
students . 

3 . The program should be funded for an academic 
year. This would tend to reduce the data loss 
which was significant dwlng the three to four 
month treatment period* More students would be 
able to return to school after their babies 
were born, increasing the number who would be 
on register at the post-testing period. 

4. In addition to the standardized tests of achieve- 
ment| or perhaps instead of these tests, con- 
sideration should be given to the use of 
criterion-reference testing. 



16 



12 



CHAPTER 7 
EXEMPURY PROORAM ABSTRACT 

Component Cede Activity Code Objective Cod, 
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^1 


6 


7 


1 





6 




1 


1 


6 


8 


1 


6 



Gains in reading and arithmetic in excess of one month^s gain 
for each month of treatment were referred to in the ITCHDINGS 
chapter* Over a treatment period of from 3 to 4 nonthSp 
subjeets whose test scores were analysed showed a 5*5 months 
gain in reading and 5*2 months gain in arlttoetie (Metropoli- 
tan Aahievement Tests). These gains are particularly meanful 
in view of the poor attendance records of the students* It 
would appear that the bilingual instructions given individual* 
ly and to small groups of students was an Important factor In 
the Improvement in the two subject-matter areas* The students 
learaed to move freely back and forth from Spanish to English, 
and were able to demonstrate improvement in reading and 
arithmetic on tests written in English, even though their 
first language was Spanish. 
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Function, No, 09'38602 



Use UU 30A. for llistorlcal Re^jression Degl^n (g-ste^ Foraula) for Reading (Eflglish); Math (Ingliih); miim (Nnii. 
English); Math (Noii-English), 

30A, Sundardizfid Test Risults, 

In the Table below, enter the riquested information ahout th testa used to evaluflte the iffectiveness of iiuijur 
project cofflponsnts/ictivitlei iji achlivln| desired objectives, This forni riquires means obtained from scori-s 
in the form of |rade equiVfllenE units as processed by the 6 step forniula (see Distrtct Evaluator's Handbook of 
Sel ecti^d Evaluation PrQcedurBi , p, 4549). Before complsting this tablij read^aU fuotnotes, Attach additfi.n.il 
sheets if necessaryi 



II 



Corapnnent 
Code 


Activity 

Code 


Test 
Usedi/ 

IfT 


Poriii 


Level 


Total 
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Group 


Nuraber 
Tested^^ 




Predicted 
Postteat 
Mean 


Actual 
Posttist 


Statistical D.ita 


Pre 
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Obtained 
Value 
of t 


luvtlST 
" of - 
signif- 
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Post 


Pre 
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Date 
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1975 
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7 
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1975 


6,30, 
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5,6' 
1975 
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1/ Identify tha test us^d and year of publication (MAT^saj CAT '-70, otcj, 
21 Total nuraber of partlcipanta in che acEivlty. 

3/ Idintify the participants by spocific grade level (e.g,, grade 3, grade 5)* Whire saveral gredii are cambinid^ in^er 

the last two digite of tha component code* 
4/ Total nunibir of participants included in the pre and postteat calculationsi ' ' 

|/ Specify livel of itatistlcal significance obtained (e.g*, p < ,05; p4*01), 

* Matropolitan Readirigj 1971 Edition 
** Metropolitan Arithmetic^ 1971 Edition 
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Bilingual IriBtruction UMiosidin^ c,nu h:.^^^^^^^^ - 

of m.nant :;on^Lm:Ush ipeu^^^^^^ ^ , Function No. 09^58602 ' ' ' 

Use Table 30C. for norm referencod aehievoment data not applicable to tables 30A, snd 3'IB. 

30C, Standardized Teat Results 

In the tibia below, enter the fequi5sted inforfflatiori about the tests uasd to evaluatp the effeetivenass of 
major project conipononts/flctivitieg in aehieving' desired objectives. Befnrp MplHing this form, riad /ill 
footnutes, Attach additional sheets if necpiiary. 

' i 



Compont-n' 
Cude 


Activity 


Test 

II j1 / 

Usidi' 


Fc 
Pre 


rin 




fel 


Total 

.,5/ 
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Group 
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Numbor 
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Statisticni 
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de 


Post 
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Post 
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Typei^ 
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Hean 




Date 
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1/ Identify Test Used and Year of Publication (^.58; CAT-TO, etc.) IJ Test statistic (e,g,, t; F; ih, 
II Total niinibir of participants In the activity 8/ Obtaiped value 

3/ Identify the participants by specific grada level (p,|,, |rade 3, 9/ Spicify level of statistical significance 
grade 5). Where several gradis are combined; enicr the last two digits obtained (e.gu pC05; p*.fll), 
of the coinponent code» " ' " 

4/ Total niiniber of participants included in the pre and post test cal- 
culations, 

5/ 1 = grnde iquivalint; 2 = peroentila rank; 3 ~ Z Score; 4 = Standard 

score {publisher's); 5 - stanine; 6 = raw scon; 7 = other, 
6/ S.D, = Standard Deviation 

* Cooperative Inter^nierican Test 
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pFFICg OF EDUCA TIOtlAl EVAMTIQH ^ DATA LOSS FCHM 
(accach ts Hi, itm i^^Q) "" Function'ij^ 
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■ r r'^^^^^^*'' 7^ graae levei ^a.g,, grade, J, grade 9 . Where aiveral gradis m eosblstd- 

enter the last tyg digits of the component code, ctwwinia, 

(2) Identify the test used and year of publication (}M-70, SDAT'74, ite.), ' ' 

(3) Nu^.ber of participants in the activity. 

(4) Number of participants included in the pre and posttegt caleulations found on iEen#30, 

(5) Nunber and percenE of particlpanti not teited and/or not analy^d on ltiini'^30. 

(6) Specify aU reasons why itudenti were not tested and/or inalyied. For each reison speeifiid, provlds 1 mmU 

nuober count. If any further docunintitlon li availible, please attach to this fora. if furthir ipici ii 
niidid to specify and gj^liin data lois, attieh additional pigfii to this, form, 
* Metropolitan Reidlni 
Jfetrbpoiltan Arithmetic 
*** Cooperative Inter^inerican Te^^^ ' 
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